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1.  Introduction 

Traditionally,  organizations  have  assessed  their  safety  perfor¬ 
mance  on  the  basis  of  “lagging  indicators”  of  safety  such  as  fatali¬ 
ties,  or  mishap  rates.  Lagging  indicators  show  when  a  desired 
safety  outcome  has  failed  or  has  not  been  achieved  (e.g.,  number 
of  mishaps).  However,  as  safety  has  improved  and  the  frequency 
of  mishaps  has  declined,  mishap  rates  have  ceased  to  be  a  useful 
metric  of  safety  performance.  Industries  in  which  performance 
may  be  catastrophically  impacted  by  failures  in  complex  human 
technology  systems  are  known  as  High  Risk  Industries  (Shrivastav- 
a,  1986).  Those  organizations  that  succeed  in  avoiding  catastrophes 
in  high  risk  environments  are  known  as  High  Reliability  Organiza¬ 
tions  (HROs;  Roberts  and  Rousseau,  1989).  Given  the  low  numbers 
of  accidents  that  occur  in  HROS,  these  organizations  have  started  to 
examine  “leading  indicators”  of  safety  in  an  attempt  to  improve 
safety  performance  even  further.  The  United  Kingdom’s  Health 
and  Safety  Executive  (HSE,  2006)  defined  leading  indicators  of 
safety  as  measures  of  process  or  inputs  essential  to  deliver  the  de¬ 
sired  safety  outcomes  (e.g.,  safety  climate  surveys,  hazard  reports). 
Therefore,  leading  indicators  of  safety  provide  a  more  proactive 
method  to  gain  insight  into  the  safety  performance  of  the  organiza¬ 
tion  and  identify  areas  in  which  efforts  should  be  made  to  improve 
safety. 

One  of  the  most  commonly  used  leading  indicators  of  safety  in 
non-aviation  HROs  is  safety  climate.  Zohar  (1980)  defined  safety 
climate  as  a  summary  of  perceptions  that  employees  share  about 
their  work  environment.  Safety  climate  describes  employees’  per¬ 
ceptions,  attitudes,  and  beliefs  about  risk  and  safety  (Mearns  and 
Flin,  1999).  It  is  a  “snapshot”  of  the  current  manifestation  of  the 
safety  culture  in  the  organization.  There  has  been  an  ongoing  de¬ 
bate  within  the  literature  regarding  the  use  of  the  terms  “culture” 
and  “climate”,  and  whether  they  represent  the  same  or  different 
concepts.  The  general  consensus  is  that  culture  represents  the 
more  stable  and  enduring  traits  of  the  organization,  and  has  been 
likened  to  "personality”.  Safety  culture  reflects  fundamental  val¬ 
ues,  norms,  assumptions,  and  expectations,  which,  to  some  extent, 
reside  in  societal  culture  (Mearns  and  Flin,  1999).  Climate,  on  the 
other  hand,  is  thought  to  represent  a  more  visible  manifestation 
of  the  culture,  which  can  be  seen  as  its  “mood  state”,  at  a  particular 
moment  in  time  (Cox  and  Flin,  1998). 

Wiegmann  and  colleagues  (Wiegmann  et  al.,  2004)  report  that 
“few  formally  documented  efforts  have  been  made  to  assess  safety 
culture  within  the  aviation  industry,  with  the  notable  exception  of 
military  aviation”  (p.  117).  This  finding  is  surprising,  given  that  the 
civilian  aviation  industry  has  been  a  leader  in  the  development  and 
utilization  of  a  number  of  human-focused  safety  programs  (e.g., 
crew  resource  management).  In  the  last  decade  there  has  been 
an  increase  in  aviation  specific  safety  climate  research  such  that 
there  is  now  sufficient  research  to  merit  a  literature  review  of  this 
work.  A  key  element  missing  from  the  literature  is  the  extent  to 
which  aviation  safety  climate  surveys  actually  measure  what  they 
are  intended  to  measure  and  discriminate  between  groups  varying 
in  safety  performance.  The  purpose  of  this  paper  is: 

•  to  carry  out  a  literature  review  of  published  aviation  safety  cli¬ 
mate  research; 

•  identify  whether  there  is  evidence  of  construct  (the  extent  to 
which  the  questionnaire  measures  what  it  is  intended  to  mea¬ 
sure)  and  discriminate  (the  ability  of  the  tool  to  differentiate 
between  organizations  or  personnel  with  different  levels  of 
safety  performance)  validity  of  the  questionnaires  used;  and 

•  make  recommendations  for  what  should  be  done  to  improve 
the  validity  of  safety  climate  assessment  in  the  aviation 
industry. 


2.  Literature  review 

2.1.  Search  methodology 

A  computerized  search  of  the  literature  was  conducted  utilizing 
PsycINFO,  Google  Scholar,  Medline,  and  Defense  Technical 
Information  Center.  Keywords  for  the  computerized  search  of  the 
literature  were:  "aviation”  with  “safety  climate”,  or  “safety  cul¬ 
ture”.  The  reference  lists  of  published  aviation  safety  climate  stud¬ 
ies  were  also  examined.  The  search  identified  a  total  of  23  studies 
reporting  a  safety  climate  evaluation  carried  out  in  aviation  (one 
study  was  published  as  both  a  report  and  journal  article).  A  total 
of  48%  of  the  studies  were  published  in  peer  review  journals,  with 
the  remainder  consisting  of  theses  (35%),  reports  (13%),  and  confer¬ 
ence  proceedings  (4%).  A  total  of  48%  of  the  studies  were  conducted 
with  US  military  populations,  with  the  remainder  carried  out  in 
commercial  aviation  organizations.  Examining  the  papers  by  occu¬ 
pational  group,  35%  were  carried  out  with  maintainers,  30%  with 
pilots,  9%  with  ground  handling  personnel,  4%  with  cabin  crew, 
and  17%  were  carried  out  with  a  mixture  of  occupational  groups. 
The  studies  are  summarized  in  Table  1,  by  occupational  group,  a 
detailed  discussion  of  the  studies  is  reported  below. 

3.  Summary  of  studies  separated  by  occupational  group 

3.1.  Commercial  pilots 

Three  studies  reported  a  safety  climate  assessment  using  com¬ 
mercial  aviation  pilots  (see  Table  1).  The  Australian  Transportation 
Safety  Board  (2004)  and  Evans  et  al.  (2007)  report  on  the  develop¬ 
ment  of  a  safety  climate  questionnaire,  designed  to  gain  insight 
into  pilots’  perceptions  of  workplace  safety.  The  questionnaire  con¬ 
sisted  of  six  safety  factors  (see  Table  1),  each  with  five  items.  These 
factors  were  based  upon  previous  safety  climate  research  and  in¬ 
put  from  aviation  safety  experts.  Data  from  half  of  the  sample  were 
used  in  an  exploratory  factor  analysis  (EFA)  that  resulted  in  a  three 
factor  model  of:  management  commitment  and  communication, 
safety  training  and  equipment,  and  maintenance.  A  confirmatory 
factor  analysis  (CFA)  on  the  remaining  half  of  the  sample  showed 
the  three  factor  model  to  be  an  adequate  fit  to  the  data.  Finally, 
the  responses  from  different  types  of  pilots  (regular  public  trans¬ 
port,  charter,  or  aerial  work  such  as  emergency  medical  services 
or  agriculture)  were  compared  on  each  of  the  four  identified  safety 
climate  factors.  No  significant  differences  between  the  groups  were 
found.  The  Australian  Transportation  Safety  Board  (2004)  con¬ 
cluded  that  this  was  due  to  a  single  professional  safety  climate 
for  pilots  as  a  group,  regardless  of  the  organization  for  whom  they 
worked. 

Gibbons  et  al.  (2006)  developed  a  questionnaire  designed  to  as¬ 
sess  safety  culture  within  the  context  of  airline  flight  operations. 
The  survey  consisted  of  84  items,  grouped  into  five  themes  (see 
Table  2).  The  survey  was  designed  by  examining  the  content  of 
safety  climate  questionnaires  that  have  been  used  in  other  HROs. 
A  total  of  503  responses  were  received  from  a  single  company. 
After  discarding  29  items  and  using  CFA,  the  analysis  eventually  re¬ 
sulted  in  a  structure  of  four  broad  factors  (organizational  commit¬ 
ment,  operations  personnel,  informal  safety  system,  and  formal 
safety  system),  with  three  subfactors  in  each.  The  authors  attribute 
their  difficulty  in  establishing  a  stable  factor  structure  with  the 
analysis  to  issues  in  item  writing  (e.g.,  ambiguity,  items  that  did 
not  relate  well  to  the  target  population).  Another  issue  not 
mentioned  in  the  paper  is  the  relatively  low  ratio  of  responses  to 
items  (6.3  items  for  every  response).  No  analysis  of  the  revised 
questionnaire  was  reported. 
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3.2.  Cabin  staff 

Kao  et  al.  (2009)  developed  a  23-item  questionnaire  to  assess 
the  safety  climate  attitudes  of  Taiwanese  cabin  crews.  The  ques¬ 
tionnaire  was  designed  to  assess  the  following  safety  climate 
themes:  management  commitment  towards  safety,  cabin  work 
environment,  rule  compliance,  crewmember  involvement  and  par¬ 
ticipation,  accident  investigation,  and  injury  incidence.  The  items 
were  based  upon  previous  safety  climate  research.  A  total  of  331 
responses  were  obtained  from  cabin  crews  from  four  major 
Taiwanese  airlines.  Using  a  structural  equation  modeling  approach, 
the  researchers  found  an  acceptable  level  of  fit  with  the  proposed 
factors.  High  management  commitment  to  safety  was  significantly 
related  to  high  crewmember  participation  in  safety,  and  that  safe 
cabin  work  environment  was  significantly  related  to  crewmem¬ 
ber’s  individual  behavior.  However,  the  findings  did  not  reveal  a  di¬ 
rect  relationship  between  management  commitment  and  injury 
incidence. 

3.3.  Ground  handlers 

Diaz  and  Cabrera  (1997)  developed  a  40-item  safety  climate 
questionnaire  for  aviation  ground  handlers,  based  upon  the  work 
of  Zohar  (1980).  Ground  handling  is  concerned  with  the  servicing 
of  an  aircraft  while  it  is  on  the  ground  at  an  airport.  Following  a 
PCA  on  the  data  collected  from  166  ground  handling  personnel 
from  three  different  companies  (the  ground  handling  division  of 
an  airline,  a  fuel  company,  and  the  airport  authority)  at  a  Spanish 
airport,  six  factors  were  identified  (see  Table  1).  Ratings  were  also 
obtained  from  29  experts  in  ground  handling  operations  on  the  le¬ 
vel  of  safety  in  each  company.  It  was  found  that  the  safety  climate 
questionnaire  responses  from  the  three  companies  were  consistent 
with  the  expert  ratings  of  the  levels  of  safety  at  the  companies.  Diaz 
and  Cabrera  (1997)  concluded  that  the  questionnaire  was  able  to 
discriminate  between  organizations  with  different  levels  of  safety. 

Ek  and  Akselsson  (2007)  evaluated  the  safety  culture  in  the 
ramp  division  of  a  ground  handling  company.  A  109-item  ques¬ 
tionnaire  was  developed  that  addressed  nine  aspects  of  safety  cli¬ 
mate  (see  Table  1).  Data  were  collected  from  50  men  employed  by 
a  single  ground  handling  company.  Acceptable  levels  of  internal 
consistency  were  found  for  each  factor.  They  concluded  that  the 
safety  climate  was  good,  but  poorer  than  desired  by  managers. 

3.4.  Aviation  maintainers 

As  part  of  a  larger  research  project,  McDonald  et  al.  (2000) 
designed  and  utilized  a  safety  climate  questionnaire  to  survey 
aviation  maintainers.  The  questionnaire  was  adapted  from  the 
one  developed  by  Diaz  and  Cabrera  (1997;  described  above).  A 
36-item  questionnaire  was  designed  based  upon  a  factor  analysis 
of  69  items  (this  analysis  was  not  reported).  A  total  of  622 
responses  were  obtained  from  aviation  maintainers  from  four  com¬ 
panies.  Significant  differences  in  climate  were  found  between 
different  occupational  groups.  McDonald  et  al.  (2000)  reported  that 
the  data  provided  evidence  of  a  strong  professional  subculture, 
which  spanned  all  of  the  four  companies  that  participated  in  the 
study.  Further,  this  subculture  is  relatively  independent  of  the 
organization.  Similar  to  the  findings  reported  in  the  ATSB  (2004) 
study  described  above,  it  was  postulated  that  the  subculture  is 
likely  to  mediate  between  the  organization’s  safety  management 
system  and  safety  outcome. 

3.5.  Air  traffic  controllers 

Gordon  et  al.  (2007)  describe  a  pilot  study  of  a  climate  survey 
designed  for  use  by  European  air  traffic  controllers  (ATC).  The 
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Table  2 

Classification  of  questionnaire  factors  into  common  safety  climate  themes. 


Questionnaire 

Management/ 

Operations 

Safety 

Procedures/ 

Communication 

Resources 

Training/ 

Risk 

Uncategorized  factors 

supervision 

personnel 

systems 

rule 

education 

Evans  et  al.  (2007) 

i ^ 

None 

Gibbons  et  al.  (2006) 

i ^ 

i * 

None 

Kao  et  al.  (2008) 

i ^ 

None 

Diaz  and  Cabrera 

is* 

^(2) 

^(2) 

None 

(1997) 

Gordon  et  al.  (2007) 

^(2  )a 

^(2) 

IS* 

<"(3) 

None 

Patankar  (2003) 

V* 

V* 

<"(2) 

Pride  in  company;  effect  of  my 
stress 

Gill  and  Shergill 

V* 

^(2) 

Regulator’s  role;  luck  and  safety 

(2004) 

CSAS 

V* 

^(2) 

None 

MCAS 

u* 

t>(2) 

^(2) 

None 

a  Numbers  in  brackets  represent  the  number  of  factors  from  a  particular  questionnaire  that  were  categorized  as  this  theme  when  more  than  one  applied. 


questionnaire  consisted  of  59  items  of  13  elements  designed 
around  three  themes  (priority  of  safety,  involvement  in  safety, 
and  learning  from  safety).  The  items  were  selected  based  upon  a 
literature  review,  50  interviews  with  ATC  personnel,  and  input 
from  subject  matter  experts  on  the  final  items  to  be  included. 
The  questionnaire  was  piloted  with  119  responses  obtained.  Fol¬ 
lowing  an  EFA  an  eight  factor  questionnaire  resulted  (see  Table  1 
for  a  description  of  the  factors).  Gordon  et  al.  (2007)  acknowledge 
that  the  sample  was  small,  and  they  state  that  a  larger  validation 
study  will  be  carried  out. 

3.6.  Combined  aviation  occupational  groups 

Four  studies  reported  the  evaluation  of  safety  culture  that  in¬ 
cluded  participants  from  a  number  of  occupational  groups. 
Patankar  (2003)  evaluated  the  safety  climate  of  a  stratified  sample 
of  399  personnel  (flight  operations,  maintenance,  and  other  per¬ 
sonnel)  from  a  single  aviation  company  using  a  common  safety 
climate  questionnaire.  After  a  factor  analysis  (no  details  of  this 
were  reported),  eight  factors  emerged  (see  Table  1).  Significant 
differences  were  found  between  flight  operations,  maintenance, 
and  “other”  personnel  with  regard  to  the  factors  of  pride  in  com¬ 
pany,  safety  opinions,  and  supervisor  trust.  Patankar  (2003) 
concluded  that,  overall,  the  respondents  were  proud  to  work  for 
the  company,  trusted  management,  and  believed  that  safety  is  a 
result  of  collective  efforts.  Both  flight  and  maintenance  personnel 
had  a  high  sense  of  personal  responsibility  for  flight  safety. 

In  a  later  study,  the  data  collected  by  Patankar  (2003;  called 
company  A)  was  compared  to  237  responses  collected  at  another 
company  (called  company  B;  Kelly  and  Patankar,  2004).  It  was 
found  that,  overall,  there  was  a  more  positive  safety  climate  at 
company  A  than  company  B.  However,  this  finding  was  partially 
attributed  to  company  A  having  older  and  more  experienced  pilots 
and  mechanics  than  company  B. 

Block  et  al.  (2007)  reanalyzed  the  responses  obtained  from  the 
281  pilots  from  the  Patankar  (2003)  sample.  The  purpose  was  to 
examine  whether  the  data  supported  what  Block  et  al.  (2007)  de¬ 
scribed  as  the  purpose-alignment-control  (PAC)  model.  A  pair  of 
experts  recoded  the  Patankar  (2003)  survey  items  in  accordance 
with  the  PAC  model.  The  proposed  factors  were  tested  using  a 
structural  equation  modeling  methodology.  The  main  drivers  of 
safety  outcomes  were  organizational  affiliation  (similar  to  ‘pride 
in  company’  from  Patankar,  2003)  and  proactive  management 
(partially  derived  from  the  ‘safety  opinion’  factor  from  Patankar, 
2003).  Organizational  affiliation  was  directly  influenced  by  com¬ 
munication,  and  proactive  management  was  influenced  by  training 
effectiveness  and  relational  supervision. 

Gill  and  Shergill  (2004)  conducted  a  safety  climate  review  across 
the  New  Zealand  commercial  aviation  industry.  The  safety  climate 


questionnaire  they  developed  included  questions  designed  to  ad¬ 
dress  two  themes:  organizations’  approach  to  safety  management 
(26  items)  and  “safety  management  systems,  and  safety  culture  in 
organizations”  (26  items).  A  factor  analysis  of  464  responses  was 
run  independently  on  each  theme.  The  “safety  management  sys¬ 
tems”  theme  was  found  to  consist  of  four  factors:  positive  safety 
practices;  safety  education;  implementation  of  safety  policies  and 
procedures;  and  individual’s  safety  responsibilities.  The  "safety  cul¬ 
ture  in  organizations”  theme  was  also  found  to  consist  of  four  sub¬ 
factors:  organizational  dynamics  and  positive  safety  practices; 
regulator’s  role;  luck  and  safety;  and  safety  management,  training, 
and  decision  making.  The  main  findings  from  the  study  were  that  pi¬ 
lots  believed  luck  and  safety  to  be  the  most  important  factor  in  avi¬ 
ation  safety,  and  employers  were  not  perceived  to  be  placing  much 
importance  on  safety  management  systems  and  safety  culture. 

3.7.  US  Naval  Aviation 

The  US  Navy  utilizes  two  different  tools  to  assess  safety  climate 
in  aviation.  The  Command  Safety  Assessment  Survey  (CSAS)  is  used 
to  obtain  feedback  from  aviators,  and  the  Maintenance  Climate 
Assessment  Survey  (MCAS)  to  obtain  information  from  aviation 
maintained.  Because  39%  of  the  studies  reviewed  in  this  paper  uti¬ 
lized  the  CSAS  and/or  the  MCAS,  we  explain  the  CSAS  and  MCAS 
and  pertinent  results  in  more  detail,  and  use  these  surveys  as  an 
example  of  how  methodological  issues  can  impact  the  interpreta¬ 
tion  of  the  survey  results. 

The  safety  culture  questionnaires  were  developed  by  research¬ 
ers  at  the  Naval  Postgraduate  School  in  Monterey,  California  (Desai 
et  al.,  2006).  Both  questionnaires  are  completed  online.  The  ques¬ 
tionnaires  were  based  upon  a  conceptual  model  of  Organizational 
Safety  Effectiveness  (MOSE)  that  identified  five  major  areas  rele¬ 
vant  to  organizations  in  managing  risk  and  developing  a  climate 
to  reduce  accidents  in  HROs  (Libuser,  1994;  Roberts,  1990).  The 
five  MOSE  areas  are: 

•  Process  auditing  -  a  system  of  ongoing  checks  to  monitor  haz¬ 
ardous  conditions. 

•  Reward  system  -  expected  social  compensation  or  disciplinary 
action  to  reinforce  or  correct  behavior. 

•  Quality  assurance  -  policies  and  procedures  that  promote  high 
quality  performance. 

•  Risk  management  -  how  the  organization  perceives  risk  and 
takes  corrective  action. 

•  Command  and  control  -  policies,  procedures,  and  communica¬ 
tion  processes  used  to  mitigate  risk. 

On  the  basis  of  observations  and  interviews  with  maintained, 
the  MCAS  has  an  additional  sixth  MOSE  called  “communication/ 
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functional  relationships”.  This  theme  is  concerned  with  having  an 
environment  in  which  information  is  freely  exchanged,  quality 
assurance  is  seen  as  a  positive  influence,  and  maintenance  workers 
are  shielded  from  external  pressures  to  complete  a  task  (Harris, 
2000).  A  description  of  the  research  that  has  been  carried  out  using 
the  MCAS  data  will  be  described  first,  followed  by  studies  that  have 
utilized  the  CSAS. 

3.7.1.  US  Naval  Aviators 

Adamshick  (2007)  analyzed  the  data  of  every  Navy  and  Marine 
Corps  Strike-Fighter  aviator  that  completed  the  CSAS  from  2001 
until  2005  (2943  responses).  He  carried  out  PCA  independently 
for  the  items  that  make  up  each  of  the  five  theoretical  factors  of 
the  CSAS.  For  all  of  the  factors,  except  for  quality  assurance  and  re¬ 
ward  systems  (for  Naval  aviators  only),  it  was  found  that  a  two  or 
more  factors  solution  resulted  in  a  better  fit  to  the  theoretically- 
derived  factors  than  a  single  factor  model. 

Gaba  et  al.  (2003)  compared  the  responses  of  health  care 
respondents  with  those  from  Naval  aviation.  Aviators  responded 
to  CSAS  and  hospital  workers  to  the  Patient  Safety  Cultures  in 
Healthcare  Organizations  (PSYCHO)  survey.  Both  of  these  instru¬ 
ments  have  partially  overlapping  items,  with  23  items  from  the 
PSYCHO  adopted  directly  from  the  CSAS.  The  survey  included 
employees  from  15  hospitals  and  Naval  aviators  from  226  squad¬ 
rons.  For  each  question  a  “problematic  response”  was  defined  as 
a  response  that  suggested  a  lack  of  or  antithesis  to  safety  climate 
(Gaba  et  al„  2003).  Overall,  the  problematic  response  rate  for  hos¬ 
pital  workers  was  up  to  12  times  greater  than  that  among  aviators 
on  certain  items.  These  findings  were  true  both  for  the  aggregate  of 
all  health  care  respondents  and,  even  more  strikingly,  for  respon¬ 
dents  from  particularly  hazardous  health  care  arenas  (e.g.,  emer¬ 
gency  rooms  and  critical  care)  the  number  of  problematic 
responses  were  16  times  greater  than  among  aviators.  This  finding 
indicated  that  the  aviators  reported  a  more  positive  safety  climate 
than  the  health  care  respondents. 

Desai  et  al.  (2006)  measured  the  relationship  between  recent 
accidents  and  perceptions  of  safety  climate,  as  measured  by  the 
CSAS,  on  a  large,  cross-sectional  sample  of  respondents  in  several 
Naval  aviation  squadrons.  The  notion  was  to  understand  potential 
cognitive  and  behavioral  changes  following  accidents.  They  hypoth¬ 
esized  that  safety  climate  would  improve  after  an  accident  oc¬ 
curred.  Moreover,  the  improvement  would  be  greater  following 
an  extremely  severe  accident  as  compared  to  a  minor  accident. 
They  postulated  that  after  a  major  accident  “managers  may  be 
motivated  to  direct  more  resources  toward  safety  than  are  manag¬ 
ers  in  groups  with  less  severe  accident  records”  (Desai  et  al.,  2006, 
p.  642).  As  a  result  of  the  increase  in  investment  in  safety  after  an 
accident,  the  safety  climate  improves.  Desai  et  al.  (2006)  also  sug¬ 
gested  that  this  argument  is  supported  by  cognitive  research  in 
that  defensive  attributions  may  increase  in  strength  as  the  severity 
of  accidents  rises. 

The  study  used  the  6361  responses  from  147  Naval  squadrons 
taking  the  online  CSAS  between  July  2000  and  December  2001. 
Aviation  mishap  information  was  collected  from  the  US  Naval 
Safety  Centre  (the  number  of  mishaps  used  was  not  reported). 
The  dependent  variable  was  a  safety  climate  perception  construct 
developed  by  aggregating  each  individual’s  responses  to  the  CSAS. 
Six  independent  variables  were  constructed  to  measure  accidents 
prior  to  survey  administration.  These  mishap  variables  were  re¬ 
corded  at  the  squadron  group  level  of  analysis.  Desai  et  al.  (2006) 
regressed  the  safety  climate  construct  on  several  indicator  vari¬ 
ables  tracking  the  occurrence  of  accidents,  grouped  by  their  sever¬ 
ity,  in  periods  roughly  1  year  prior  to  survey  measurement  and 
2  years  prior  to  survey  measurement.  Analysis  indicated  positive 
associations  between  minor  or  intermediately  severe  accidents 
and  future  safety  climate  scores,  although  no  effect  was  found 


for  major  accidents.  These  findings  suggest  a  generally  positive 
association  between  minor  or  intermediately  severe  accidents 
and  perceived  safety  climate.  This  study  suffers  in  that  only  limited 
information  was  obtained  on  the  mishaps.  Also,  although  the  num¬ 
ber  of  mishaps  that  occurred  during  the  period  of  study  were  not 
reported,  the  number  was  likely  to  be  fairly  low.  Finally,  the  ratio¬ 
nale  that  the  safety  climate  will  improve  after  a  mishap  may  be 
flawed.  If  the  squadron  personnel  believe  that  the  causes  of  the 
mishap  have  not  been  addressed,  it  may  be  that  the  safety  climate 
may  go  down,  rather  than  improve,  as  suggested  by  Desai  et  al. 

Buttrey  et  al.  (2010)  attempted  to  establish  the  construct  valid¬ 
ity  of  the  CSAS.  They  used  1 10,014  responses  to  the  CSAS  collected 
over  8  years.  Utilizing  a  combination  of  EFA  and  CFA,  Buttrey  et  al. 
were  unable  to  identify  a  stable  factor  structure  for  the  61  item 
CSAS.  They  attribute  this  finding  to  the  effect  of  the  non-constant 
variance  of  the  data.  The  lack  of  a  constant  variance  renders  stan¬ 
dard  statistical  tests  invalid.  The  data  was  reduced  by  retaining  only 
the  12  items  which  had  substantial  variance,  and  to  those  with  a  re¬ 
sponse  time  of  greater  than  10  minutes  to  complete  the  question¬ 
naire  (time  to  complete  was  collected  since  2006,  and  was  used 
as  a  metric  to  discard  respondents  who  were  suspected  of  not  giv¬ 
ing  the  cognitive  effort  required  to  complete  the  questionnaire). 
Using  a  combination  of  EFA  and  CFA,  with  the  22,000  remaining 
respondents,  a  stable  two  factor  structure  (personnel  leadership 
and  integration  of  safety  and  operations)  was  established. 

3.7.2.  US  Naval  Aviation  Maintained 

A  considerable  amount  of  work  examining  the  psychometric 
properties  of  the  MCAS  was  carried  out  by  Naval  Postgraduate 
School  Masters’  students  in  the  late  1990s  and  early  2000s  (see 
Table  1).  The  MCAS  was  developed  by  Baker  (1998)  directly  from 
the  CSAS.  He  carried  out  Principal  Component  Analysis  (PCA)  on 
268  responses  from  the  maintenance  personnel  of  three  reserve 
Naval  squadrons.  He  found  that  25  out  of  the  67  items  loaded  on  a 
single  principle  component.  However,  as  all  of  the  six  MOSEs  were 
represented  in  this  principle  component,  he  concluded  that  there 
is  no  evidence  against  the  construct  validity  of  the  questionnaire. 

As  a  result  of  the  analysis,  Baker  (1998)  proposed  a  revision  of  the 
questionnaire  consisting  of  35  items.  As  can  be  seen  from  Table  1, 
using  Baker’s  revised  survey  with  slightly  different  sub-populations, 
Oneto  (1999),  Goodrum  (1999),  Harris  (2000),  and  Hernandez 
(2001)  all  drew  similar  conclusions  regarding  the  factor  structure. 
That  is,  a  PCA  resulted  in  one  single  principle  component  that 
explained  a  third  of  the  variance,  with  almost  all  of  the  items  from 
the  questionnaire  loading  on  this  principle  component.  Baker 
(1998),  Oneto  (1999),  Goodrum  (1999),  Harris  (2000),  and 
Hernandez  (2001)  interpreted  the  finding  of  one  MCAS  principle 
component  with  all  of  the  MOSE  categories  represented  as  evidence 
that  the  MCAS  was  theoretically  sound.  Harris  (2000)  and  Hernandez 
(2001)  also  analyzed  whether  there  was  a  relationship  between 
MCAS  score  and  aircraft-maintenance-related  incident  rate.  Neither 
author  reported  a  significant  relationship. 

Most  recently,  Brittingham  (2006)  examined  the  MCAS  re¬ 
sponses  from  126,058  maintainers  collected  between  2000  and 
2005.  After  completing  a  PCA,  she  found  that,  prior  to  rotation, 
one  principle  component  accounted  for  approximately  50%  of  the 
variance.  She  states  that  after  varimax  rotation,  a  second  principle 
component  emerged.  The  first  principle  component  consisted  of 
items  concerned  with  overall  command  attention  to  safety,  and 
the  second  related  to  workload  and  the  availability  of  appropriate 
resources.  Brittingham  (2006)  interpreted  the  failure  to  find  the 
six  MOSE  components  as  individual  factors  in  the  PCA  process  to 
mean  that  “the  MCAS  was  found  to  be  an  inadequate  tool  with 
questionable  validity  for  gauging  maintenance  safety  climate” 
(Brittingham,  2006,  p.  31).  This  conclusion  contradicts  the  prior 
conclusions  (Baker,  1998;  Oneto,  1999;  Goodrum,  1999;  Harris, 
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2000;  Hernandez,  2001)  that  the  MCAS  was  a  valid  tool  because 
the  single  principle  component  represented  all  of  the  MCAS  items. 

It  could  be  argued  that  both  the  interpretation  of  Brittingham 
(2006)  and  that  of  the  earlier  studies  are  flawed,  due  to  the  lack 
of  a  clear  understanding  of  the  methodology  that  was  employed 
to  identify  the  principle  components.  PCA  is  the  method  to  use 
when  the  researcher  is  attempting  to  reduce  a  large  number  of 
variables  to  a  smaller  number  of  components  (Stevens,  1996). 
PCA  analyzes  variance  with  the  goal  of  extracting  the  maximum 
variance  from  a  data  set  with  a  few  orthogonal  (i.e„  uncorrelated) 
components  (Tabachnick  and  Fidell,  1996).  Because  principle  com¬ 
ponent  scores  are  always  uncorrelated  by  construction,  unrotated 
PCA  never  accounts  for  correlations  between  the  presumed  factors 
underlying  the  observations.  Furthermore  principle  components 
(or  their  coefficients)  are  never  chosen  with  reference  to  a  body 
of  theory;  they  always  arise  automatically  from  the  maximization 
of  variance  explained. 

Another  related  issue,  which  may  have  accounted  for  the  major¬ 
ity  of  items  loading  on  a  single  principle  component,  is  the  large 
proportion  of  respondents  responding  positively  to  the  items.  To 
illustrate,  Goodrum  (1999)  reported  that  all  questions  were  an¬ 
swered  positively,  with  a  mean  range  of  between  3.17  and  4.37 
(on  a  5-point  scale).  Hernandez  (2001)  reported  a  mean  range  be¬ 
tween  3.18  and  4.15  for  the  items.  Therefore,  it  would  appear  that 
there  is  limited  variability  in  the  responses  to  the  items.  This  lim¬ 
ited  variability  creates  problems  when  carrying  out  a  PCA  because 
if  all  of  the  items  have  a  similar  lack  of  variability,  then  the  PCA  will 
tend  to  identify  one  principle  component  with  a  large  number  of 
items.  Thus,  it  could  be  argued  the  PCA  is  an  inappropriate  method 
for  identifying  factors  when  variability  in  responses  are  limited, 
and  researchers  may  want  to  consider  other  exploratory  or  confir¬ 
matory  factor  analysis  techniques.  We  now  turn  to  studies  employ¬ 
ing  the  CSAS.  In  the  next  sections,  the  safety  climate  questionnaires 
that  were  used  will  be  assessed  to  allow  conclusions  to  be  made 
about  their  construct  and  discriminate  validity. 


4.  Assessing  construct  validity 

Construct  validity  is  concerned  with  the  extent  to  which  the 
questionnaire  measures  the  underlying  theoretical  construct  it  in¬ 
tends  to  measure.  The  identification  of  a  reliable  factor  structure, 
that  is  consistent  with  theory,  helps  the  researcher  substantiate 
claims  regarding  the  construct  validity  of  the  questionnaire.  The 
construct  validity  of  the  questionnaires  will  firstly  be  assessed  by 
examining  whether  the  factors  identified  by  each  are  consistent 
with  the  broader  safety  climate  literature,  and  then  whether  the 
factors  identified  from  each  questionnaire  converge  upon  a  com¬ 
mon  set  of  safety  climate  themes  that  are  consistent  across  all  of 
the  questionnaires. 

Of  the  10  unique  safety  climate  questionnaires  that  were  identi¬ 
fied  from  the  literature  review,  it  was  decided  to  remove  the  Ek  and 
Akselsson  (2007)  from  the  analysis  due  to  the  small  sample  size, 
and  lack  of  a  factor  analysis  of  the  questionnaire.  The  factors  re¬ 
ported  in  the  remaining  questionnaires  were  categorized  into  eight 
broad  safety  climate  themes  (see  Table  2).  We  found  that  only  three 
factors  did  not  specifically  fit  within  the  above  eight  themes. 

The  safety  climate  themes  identified  in  Table  2  are  broadly  in 
agreement  with  a  number  of  reviews  of  the  safety  climate  litera¬ 
ture  (e.g.  Flin  et  al.,  2000;  Gadd  and  Collins,  2002;  Guldenmund, 
2000;  Hale  and  Hovden,  1998;  Shannon  et  al.,  1997).  These  themes 
are  discussed  below. 

•  Management/supervision:  All  of  the  aviation  safety  climate  ques¬ 
tionnaires  had  a  factor  concerned  with  management/supervi¬ 
sion.  Similarly,  a  factor  concerned  with  management  has  been 


identified  about  75%  of  the  time  in  other  safety  climate  research 
(Gadd  and  Collins,  2002;  Flin  et  al.,  2000).  The  importance  of 
interactions  between  managers  and  workers  has  been  clearly 
established  through  research  (e.g.  Hale  and  Hovden,  1998). 
Specifically,  management  participation  and  involvement  in 
work  and  safety  activities,  as  well  as  frequent,  informal  commu¬ 
nications  between  workers  and  management,  are  recognized  as 
critical  behaviors. 

•  Safety  systems:  A  factor  related  to  safety  systems  is  identified  in 
about  two-thirds  of  safety  climate  studies  (Gadd  and  Collins, 
2002;  Flin  et  al.,  2000).  Mearns  et  al.  (1998)  found  that  reporting 
systems,  rules  and  procedures,  and  safety  systems  were  among 
the  key  factors  related  to  self-reported  accident  involvement. 

•  Procedures/rule:  Guldenmund  (2000)  identified  procedural  and 
rule  compliance  as  one  of  the  most  frequently  occurring  themes 
in  his  review  of  safety  climate  research.  Perceptions  of  safety 
rules,  attitudes  to  rules  and  compliance,  and  violation  of  proce¬ 
dures  are  addressed. 

•  Training/education:  The  workforce’s  perception  of  the  general 
level  of  workers’  qualifications,  skills,  and  knowledge  is  the 
essence  of  this  theme.  Cooper  and  Phillips  (2004)  demonstrated 
that  workers’  perceptions  of  the  significance  of  safety  training 
were  the  most  important  safety  climate  factor  predicting  actual 
safety  behavior. 

•  Risk:  Higher  threat  perception  is  positively  related  to  safe 
behaviors.  For  example,  Goldberg  et  al.  (1991 )  found  that  a  high 
threat  perception  was  related  to  readiness  to  participate  in 
safety  programs,  the  relationship  was  mediated  by  coworker 
support  for  safety. 

Despite  the  broad  agreement  with  the  themes  identified  in 
other  safety  climate  research  carried  out  in  HROs,  three  themes 
emerged  as  being  particularly  relevant  to  aviation.  These  themes 
are  discussed  below. 

•  Communication:  Four  of  the  aviation  safety  questionnaires  had 
factors  concerned  with  communication  (see  Table  2).  The  avia¬ 
tion  industry  consists  of  different  occupational  groups  (e.g.  air 
traffic  control,  maintenance,  cabin  personnel,  pilots,  dispatch) 
that  are  not  co-located.  This  presents  challenges  to  communica¬ 
tion  and  means  that  personnel  may  not  have  the  capacity  for 
direct  communication,  and  by  implication,  the  ability  to  engage 
in  informal  and  spontaneous  interaction.  As  a  result,  safety 
communication  may  be  more  of  a  challenge  in  the  aviation 
industry  than  other  HROs  in  which  personnel  are  co-located. 

•  Resources:  Three  aviation  safety  climate  questionnaires  had  fac¬ 
tors  that  were  categorized  as  resources  (see  Table  2).  This  factor 
is  concerned  with  the  availability  of  resources  for  safety  (e.g. 
money,  time,  equipment,  etc.).  This  is  unlikely  to  be  an  aviation 
specific  issue.  However,  a  resources  factor  was  only  included  in 
the  three  most  recently  developed  aviation  safety  climate  ques¬ 
tionnaires  (see  Table  2).  Therefore,  it  is  possible  that  due  to  the 
current  economic  climate  the  availability  of  resources  for 
improving  safety  has  become  more  relevant  than  it  was  in  the 
past. 

•  Operations  personnel:  This  theme  was  concerned  with  the  com¬ 
mitment  of  the  operations  personnel  to  safety.  This  theme  has 
aspects  of  what  Flin  et  al.  (2000)  categorized  as  ‘work  pressure’ 
and  ‘competence’  in  their  review  of  the  safety  climate  literature. 
It  is  suggested  that  due  to  the  different  specialized  occupational 
groups  in  the  aviation  industry,  that  it  may  be  necessary  to 
include  a  specific  factor  that  address  the  safety  commitment 
of  operations  personnel. 

To  summarize,  all  nine  of  the  questionnaires  reviewed  consisted 
of  safety  climate  factors  that  are  in  agreement  with  the  broader 
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literature  on  safety  climate  in  HROs.  Although  there  are  themes 
that  may  be  particularly  relevant  to  safety  climate  in  an  aviation 
environment,  these  are  not  inconsistent  with  the  safety  climate  lit¬ 
erature.  However,  there  was  a  lack  of  convergence  on  a  specific  set 
of  safety  themes  that  were  consistent  across  all  of  the  question¬ 
naires  reviewed.  From  Table  2  it  can  be  seen  that  the  only  theme 
that  is  addressed  in  all  nine  questionnaires  was  management  and 
supervision.  The  threat  to  discriminate  validity  of  a  lack  of  com¬ 
mon  safety  climate  themes  is  not  confined  to  aviation  safety  cli¬ 
mate  measures,  but  does  occur  in  safety  climate  questionnaires 
more  generally  (Flin  et  al.,  2000;  Gadd  and  Collins,  2002).  Never¬ 
theless,  given  the  questionnaires  in  this  review  were  all  designed 
to  assess  safety  climate  within  aviation,  it  might  be  expected  that 
there  would  be  greater  convergence  in  the  safety  climate  con¬ 
structs  assessed.  Therefore,  although  there  is  evidence  for  some 
construct  validity,  the  lack  of  a  consistent  set  of  common  safety  cli¬ 
mate  themes  is  an  issue. 


5.  Assessing  discriminate  validity 

In  addition  to  establishing  the  construct  validity  of  a  safety  cli¬ 
mate  questionnaire,  it  is  also  necessary  to  determine  the  discrimi¬ 
nate  validity,  if  the  tool  is  unable  to  differentiate  between 
organizations  or  personnel  with  different  levels  of  safety  perfor¬ 
mance,  then  it  is  of  limited  usefulness.  The  discriminate  validity 
can  be  assessed  by  correlating  the  data  from  the  questionnaire 
with  a  criterion  variable  such  as  accidents,  or  other  safety-related 
behavior  (Guldenmund,  2007).  In  recent  years,  a  large  number  of 
research  studies  in  HROs  have  sought  to  examine  the  contribution 
of  safety  climate  to  accidents.  The  challenge  facing  researchers  has 
been  to  highlight  measurable  dimensions  of  safety  climate  that  can 
be  used  to  identify,  in  advance,  the  strengths  and  weaknesses  with¬ 
in  an  organization  that  influence  the  likelihood  of  accidents  occur¬ 
ring.  A  variety  of  different  criteria  are  used  upon  which  to  base 
evaluations  of  organizational  effectiveness  in  preventing  accidents. 

•  Company  accident  statistics:  Such  studies  have  shown  that  the 
degree  of  safety  program  development  and  workers’  safety  ini¬ 
tiative  were  related  to  lower  work  accident  and  injury  rates 
(Zohar,  2000;  Donald  and  Canter,  1994;  Mearns  et  al.,  2004). 

•  High  and  low-accident-rate  plants:  Other  studies  have  compared 
high-  and  low-accident-rate  plants  (or  evaluated  plants  with 
outstanding  safety  records)  as  their  criteria  upon  which  to  base 
judgments  of  effectiveness.  For  example,  management’s  com¬ 
mitment  to  safety  was  found  to  be  greater  in  low-accident-rate 
plants  than  in  the  high-accident-rate  plants  (Cohen  et  al.,  1975; 
Smith  et  al.,  1978;  Cohen  and  Cleveland,  1983). 

•  Self  report:  Self-reported  safety  behavior  and  safety  attitudes  are 
an  alternative  to  relying  on  mishaps  data  to  evaluate  the  effec¬ 
tiveness  of  an  organization’s  safety  program.  For  example, 
Thompson  et  al.  (1998)  suggested  that  minor  workplace  acci¬ 
dents  often  go  unreported,  yet  these  events  may  be  the  best 
indicators  of  improving  (or  worsening)  safety  conditions  that 
might  eventually  lead  to  serious  injury. 

As  can  be  seen  from  Table  1,  only  four  studies  attempted  to 
establish  the  discriminate  validity  of  the  aviation  safety  climate 
survey.  Kao  et  al.  (2009)  found  no  relationship  between  manage¬ 
ment  commitment  and  self-reported  injury  incidents.  Neither 
Harris  (2000),  nor  Hernandez  (2001)  found  a  significant  link  be¬ 
tween  MCAS  responses  and  maintenance  incidents  in  US  Navy 
squadrons.  The  only  study  in  which  evidence  of  discriminate  valid¬ 
ity  was  found  was  in  Diaz  and  Cabrera’s  (1997)  assessment  of  the 
safety  climate  of  ramp  personnel.  As  discussed  in  the  literature 
review,  the  safety  climate  measures  were  found  to  be  in  agreement 


with  expert  ratings  of  the  three  company’s  level  of  safety.  This  find¬ 
ing  is  encouraging.  However,  no  statistical  assessment  was  carried 
out  to  measure  the  strength  of  this  link.  Further,  no  attempt  was 
made  to  link  the  safety  climate  responses  with  actual  safety  perfor¬ 
mance  measures  such  as  mishap  rates,  hazard  reports,  etc.  Therefore, 
although  the  questionnaires  would  appear  to  have  construct 
validity,  there  is  insufficient  evidence  for  discriminate  validity. 


6.  Recommendations 

it  is  recommended  that  rather  than  constructing  more  aviation 
safety  climate  questionnaires,  researchers  (and  sponsors)  should 
focus  on  establishing  the  discriminate  validity  of  existing  measures 
by  correlating  safety  climate  with  other  measures  of  safety  perfor¬ 
mance.  Similar  to  other  HROs,  the  accident  rate  in  commercial  avi¬ 
ation  is  so  low  that  it  is  not  a  useful  metric  of  safety  performance. 
To  illustrate,  for  US  commercial  aviation,  the  accident  rate  was  0.2 
per  100,000  flight  hours  from  2000  until  2009  (NTSB,  2010),  com¬ 
pared  to  1.5  major  accidents  per  100,000  flight  hours  in  US  Naval 
Aviation  over  the  same  period  (Naval  Safety  Center,  2010).  As  the 
CSAS  has  been  used  by  the  US  Navy  to  collect  safety  climate  infor¬ 
mation  for  close  to  a  decade,  there  may  be  a  sufficient  numbers  of 
accidents  such  that  they  can  be  used  as  a  metric  to  evaluate  the 
discriminate  validity  of  the  CSAS.  In  commercial  aviation  other 
metrics  of  safety  performance  should  be  used  to  evaluate  the  dis¬ 
criminate  validity  of  safety  climate  questionnaires. 

For  example,  many  commercial  aviation  companies  have  an 
Aviation  Safety  Action  Program  (ASAP)  to  encourage  employees 
to  voluntarily  report  safety  information  (see  FAA,  2002,  for  a  dis¬ 
cussion  of  these  programs).  In  addition,  to  ASAPs,  many  companies 
also  have  a  voluntary  Flight  Operational  Quality  Assurance  (FOQA) 
program.  FOQA  uses  quick  access  recorders  to  identify  deviations 
for  flight  parameters  specified  in  the  standard  operating  proce¬ 
dures  (Civil  Aviation  Authority;  CAA,  2003).  This  information  can 
be  used  to  identify  inadequate  procedures,  ineffective  training 
and  briefing,  poor  team  skills,  fuel  inefficiency  and  environmental 
impact,  aerodynamic  inefficiency,  power  plant  deterioration,  and 
systems  deficiencies  (Holtom,  2000).  To  assess  the  discriminate 
validity  of  a  safety  climate  questionnaire  in  commercial  aviation, 
it  will  be  necessary  to  obtain  safety  performance  information, 
and  questionnaire  responses,  from  a  number  of  companies.  This  le¬ 
vel  of  access,  and  co-operation,  will  undoubtedly  be  challenging. 
Nevertheless,  collaboration  between  rival  companies  with  the  goal 
of  improving  safety  climate  has  been  achieved  in  other  domains, 
such  as  the  offshore  oil  and  gas  industry  (Mearns  et  al.,  2003).  Pool¬ 
ing  safety  climate  data  across  companies  provides  a  larger  sample 
size  for  analysis,  and  allows  the  discriminate  validity  to  be 
evaluated. 


7.  Conclusion 

Although  there  is  evidence  that  the  aviation  questionnaires  that 
were  reviewed  in  this  paper  have  some  construct  validity  to  the  ex¬ 
tent  to  which  factors  identified  were  consistent  with  theory,  there 
was  a  lack  of  convergence  upon  a  common  set  of  safety  climate 
constructs  that  were  consistent  across  all  of  the  questionnaires. 
Support  for  the  discriminate  validity  of  these  measures  was  also 
found  to  be  lacking.  In  the  absence  of  evidence  supporting  a  link 
between  safety  climate  and  other  measures  of  performance  it  will 
be  difficult  to  convince  the  aviation  industry  of  the  utility  of  the 
survey  as  an  accident  prevention  tool.  Nevertheless,  it  is  important 
to  note  that  it  is  unlikely  that  a  strong  relationship  between  safety 
climate  and  other  measures  of  safety  performance  will  be  estab¬ 
lished  (see  Clarke,  2006  for  a  discussion). 
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The  aviation  industry  has  an  advantage  over  many  other  high 
reliability  industries  in  that  it  has  international  safety  regulatory 
bodies  to  which  all  member  states  must  comply  (e.g.  the  European 
Aviation  Safety  Agency,  EASA).  Moreover,  EASA  and  other  aviation 
regulatory  bodies  such  as  the  Federal  Aviation  Authority  and  the 
Civil  Air  Navigation  Services  Organization  have  recognized  the 
importance  of  safety  culture  and  are  engaged  in  research  exploring, 
measuring  and  enhancing  safety  climate  (EUROCONTR,  2008).  We 
argue  that  given  the  involvement  of  these  regulatory  bodies,  along 
with  the  other  areas  of  standardization  within  the  aviation  indus¬ 
try,  it  may  be  possible  to  access  a  large  pool  of  safety  climate  and 
safety  performance  data  to  allow  a  valid  aviation  safety  climate 
tool  to  be  developed  that  can  be  shown  to  have  utility  in  prevent¬ 
ing  accidents. 

Acknowledgements 

This  work  was  funded  by  the  Defense  Safety  Oversight  Council 
(DSOC).  All  opinions  stated  in  this  paper  are  those  of  the  authors 
and  do  not  necessarily  represent  the  opinion  or  position  of  the 
US  Navy,  the  Naval  Postgraduate  School,  or  the  National  University 
of  Ireland,  Galway. 

References 

Adamshick,  M.H.,  2007.  Leadership  and  Safety  Climate  in  High-Risk  Military 
Organizations.  Ph.D.  Dissertation.  University  of  Maryland,  College  Park,  MD. 
Australian  Transportation  Safety  Board,  2004.  ATSB  Aviation  Safety  Survey  -  Safety 
Climate  Factors.  Author,  Canberra,  Australia. 

Baker,  R.,  1998.  Climate  Survey  Analysis  for  Aviation  Maintenance  Safety.  Master’s 
Thesis,  Naval  Postgraduate  School,  Monterey,  CA. 

Block,  E.E.,  Sabin,  E.J.,  Patankar,  M.S.,  2007.  The  structure  of  safety  climate  for 
accident  free  flight  crews.  International  Journal  of  Applied  Aviation  Studies  7 
(1),  46-59. 

Brittingham,  A.,  2006.  The  relationship  between  Naval  Aviation  Mishaps  and 
Squadron  Maintenance  Safety  Climate.  Master’s  Thesis,  Naval  Postgraduate 
School,  Monterey,  CA. 

Buttrey,  S.,  O’Connor,  P.,  O’Dea,  A.,  2010.  An  Evaluation  of  the  Construct  Validity  of 
the  Command  Safety  Assessment  Survey  (CSAS).  Naval  Postgraduate  School, 
Monterey,  CA. 

Civil  Aviation  Authority,  2003.  Flight  Data  Monitoring:  A  Guide  to  Good  Practice. 
Author,  London. 

Clarke,  S.,  2006.  The  relationship  between  safety  climate  and  safety  performance:  a 
meta-analytic  review.  Journal  of  Occupational  Health  Psychology  11  (4),  315- 
327. 

Cohen,  H.,  Cleveland,  R.,  1983.  Safety  program  practices  in  record-holding  plants. 
Professional  Safety  1  (March),  26-33. 

Cohen,  A.,  Smith,  M.,  Cohen,  H.,  1975.  Safety  Program  Practices  in  High  Versus  Low 
Accident  Rate  Companies  -  and  Interim  Report  (Publication  No.  75-185). 
National  Institute  for  Occupational  Safety  and  Health:  US  Department  of  Health 
Education  and  Welfare,  Cincinnati. 

Cooper,  M.D.,  Phillips,  R.A.,  2004.  Exploratory  analysis  of  the  safety  climate  and 
safety  behavior  relationship.  Journal  of  Safety  Research  35  (5),  497-512. 

Cox,  S.,  Flin,  R.,  1998.  Safety  culture:  philosopher’s  stone  or  man  of  straw.  Work  and 
Stress  12  (3),  189-201. 

Desai,  V.M.,  Roberts,  K.H.,  Ciavarelli,  A.P.,  2006.  The  relationship  between  safety 
climate  and  recent  accidents:  behavioral  learning  and  cognitive  attributions. 
Human  Factors  48,  639-650. 

Diaz,  R.T.,  Cabrera,  D.D.,  1997.  Safety  climate  and  attitude  as  evaluation  measures  of 
organizational  safety.  Accident  Analysis  and  Prevention  29  (5),  643-650. 
Donald,  I.,  Canter,  D.,  1994.  Employee  attitudes  and  safety  in  the  chemical  industry. 

Journal  of  Loss  Prevention  in  the  Process  Industries  7  (3),  203-208. 

Ek,  A.,  Akselsson,  R.,  2007.  Aviation  on  the  ground:  safety  culture  in  a  ground 
handling  company.  The  International  Journal  of  Aviation  Psychology  17,  59-76. 
EUROCONTROL,  2008.  Safety  Culture  in  Air  Traffic  Management:  A  White  Paper. 
Author,  Brussels,  Belgium. 

Evans,  B.,  Glendon,  I.,  Creed,  P.A.,  2007.  Development  and  initial  validation  of  an 
aviation  safety  climate  scale.  Journal  of  Safety  Research  38  (6),  675-682. 
Federal  Aviation  Authority,  2002.  Advisory  Circular  No.  120-66B:  Aviation  Safety 
Action  Program  (ASAP).  Author,  Washington,  DC. 

Flin,  R.,  Mearns,  K.,  O’Connor,  P.,  Bryden,  R.,  2000.  Safety  climate:  identifying  the 
common  features.  Safety  Science  34,  177-192. 

Gaba,  D.M.,  Singer,  S.J.,  Sinaiko,  A.D.,  Bowen,  J.D.,  Ciavarelli,  A.P.,  2003.  Difference  in 
safety  climate  between  hospital  personnel  and  naval  aviators.  Human  Factors 
45,  173-185. 

Gadd,  S.,  Collins,  A.M.,  2002.  Safety  Culture:  A  Review  of  the  Literature.  Health  and 
Safety  Laboratory,  Sheffield,  UK. 


Gibbons,  A.M.,  von  Thaden,  T.L.,  Wiegmann,  D.A.,  2006.  Development  and  initial 
validation  of  a  survey  for  assessing  safety  culture  within  commercial  flight 
operations.  International  Journal  of  Aviation  Psychology  16  (2),  215-238. 

Gill,  G.K.,  Shergill,  G.S.,  2004.  Perceptions  of  safety  management  and  safety  culture 
in  the  aviation  industry  in  New  Zealand.  Journal  of  Air  Transport  Management 
10,  233-239. 

Goldberg,  A.I.,  Dar-El,  E.M.,  Rubin,  A.E.,  1991.  Threat  perception  and  the  readiness  to 
participate  in  safety  programs.  Journal  of  Organizational  Behaviour  12,  109- 
122. 

Goodrum,  B.,  1999.  Assessment  of  Maintenance  Safety  Climate  in  US  Navy  Fleet 
Logistics  Support  Wing  Squadrons.  Master’s  Thesis,  Naval  Postgraduate  School, 
Monterey,  CA. 

Gordon,  R.,  Kirwan,  B.,  Mearns,  K.,  Kennedy,  R.,  Jensen,  C.L.,  2007.  A  Safety  Culture 
Questionnaire  for  European  Air  Traffic  Control,  (http://www.eurocontrol.int/ 
eec/gallery/content/public/documents/EEC_safety_documents/ 
Gordon_et_al_ESREL_2007.doc)  (retrieved  5.11.09). 

Guldenmund,  F.,  2000.  The  nature  of  safety  culture:  a  review  of  theory  and  research. 
Safety  Science  34,  215-257. 

Guldenmund,  F.,  2007.  The  use  of  questionnaires  in  safety  culture  research  -  an 
evaluation.  Safety  Science  45  (6),  723-743. 

Hale,  A.R.,  Hovden,  J.,  1998.  Management  and  culture:  the  third  age  of  safety.  A 
review  of  approaches  to  organizational  aspects  of  safety,  health  and 
environment.  In:  Feyer,  A.M.,  Williamson,  A.  (Eds.),  Occupational  Injury:  Risk 
Prevention  and  Intervention.  Taylor  and  Francis,  London,  pp.  117-119. 

Harris,  C.,  2000.  An  Evaluation  of  the  Aviation  Maintenance  Safety  Climate  Survey 
(MCAS),  Applied  to  the  3rd  Marine  Air  Wing.  Master’s  Thesis,  Naval 
Postgraduate  School,  Monterey,  CA. 

Health  and  Safety  Executive,  2006.  Developing  Process  Safety  Indicators.  HSE, 
London,  UK. 

Hernandez,  A.E.,  2001.  Organizational  Climate  and  its  Relationship  with  Aviation 
Maintenance  Safety.  Master’s  Thesis,  Naval  Postgraduate  School,  Monterey,  CA. 

Holtom,  M.,  2000.  Properly  managed  FOQA  programme  represents  an  important 
safety  tool  for  airlines.  ICAO  Journal  2000  (January/February),  7-8. 

Kao,  L.,  Stewart,  M.,  Lee,  K.,  2009.  Using  structural  equation  modeling  to  predict 
cabin  safety  outcomes  among  Taiwanese  airlines.  Transportation  Research:  Part 
E:  Logistics  and  Transportation  Review  45  (2),  357-365. 

Kelly,  T.,  Patankar,  M.S.,  2004.  Comparison  of  Organizational  Safety  Cultures  at  Two 
Aviation  Organizations.  In:  Paper  Presented  at  the  Safety  Across  High- 
Consequence  Industries  Conference,  St.  Louis,  Missouri  (May). 

Libuser,  C.B.,  1994.  Organizational  Structure  and  Risk  Mitigation,  Ph.D.  Dissertation. 
University  of  California  at  Los  Angeles,  Los  Angeles,  CA. 

McDonald,  N.,  Corrigan,  S.,  Daly,  C.,  Cromie,  S.,  2000.  Safety  management  systems 
and  safety  culture  in  aircraft  maintenance  organization.  Safety  Science  34, 151- 
176. 

Mearns,  K.,  Flin,  R.,  1999.  Assessing  the  state  of  organizational  safety  -  culture  or 
climate.  Current  Psychology  18  (1),  5-17. 

Mearns,  K.,  Flin,  R.,  Gordon,  R.,  Fleming,  M.,  1998.  Measuring  safety  climate  on 
offshore  installations.  Work  and  Stress  12  (3),  238-254. 

Mearns,  K.,  Whitaker,  S.,  Flin,  R.,  Gordon,  R.,  O’Connor,  P.,  2003.  Factoring  the 
Human  into  Safety  Translating  Research  into  Practice,  vol.  1.  Benchmarking 
Human  and  Organisational  Factors  in  Offshore  Safety.  Her  Majesty’s  Stationary 
Office,  Norwich,  England. 

Mearns,  K.,  Rundmo,  T.,  Flin,  R.,  Gordon,  R.,  Fleming,  M.,  2004.  Evaluation  of 
psychosocial  and  organizational  factors  in  offshore  safety:  a  comparative  study. 
Journal  of  Risk  Research  7  (5),  545-561. 

National  Transportation  Safety  Board,  2010.  Aviation  Accident  Statistics. 
<www.ntsb.gov/aviation/Table5.htm>  (retrieved  5.07.10). 

Naval  Safety  Center,  2010.  Class  A  Flight  Mishaps,  <http://www.public.navy.mil/ 
navsafecen/Documents/statistics/execsummary/ 
Daily_Mishap_Stats.ppt#506,l,Slidel>  (retrieved  5.07.10). 

Oneto,  T.,  1999.  Safety  Climate  Assessment  in  Naval  Reserve  Aviation  Maintenance 
Operations.  Master’s  Thesis,  Naval  Postgraduate  School,  Monterey,  CA. 

Patankar,  M.S.,  2003.  A  study  of  safety  culture  at  an  aviation  organization. 
International  Journal  of  Applied  Aviation  Studies  3  (2),  243-259. 

Roberts,  K.H.,  1990.  Managing  high-reliability  organizations.  California 

Management  Review  32, 101-113. 

Roberts,  K.H.,  Rousseau,  D.M.,  1989.  Research  in  nearly  failure-free,  high-reliability 
organizations:  having  the  bubble.  IEEE  Transactions  on  Engineering 
Management  36  (2),  132-139. 

Shannon,  H.S.,  Mayr,  J.,  Haynes,  T.,  1997.  Overview  of  the  relationship  between 
organizational  and  workplace  factors  and  injury  rates.  Safety  Science  26  (3), 
201-217. 

Shrivastava,  P.,  1986.  Bhopal.  Basic  Books,  New  York. 

Smith,  M.,  Cohen,  H.,  Cohen,  A.,  Cleveland,  R.,  1978.  Characteristics  of  successful 
safety  programs.  Journal  of  Safety  Research  10  (1),  5-15. 

Stanley,  B„  2000.  Evaluating  Demographic  Item  Relationships  with  Survey 
Responses  on  the  Maintenance  Climate  Assessment  Survey  (MCAS).  Master’s 
Thesis,  Naval  Postgraduate  School,  Monterey,  CA. 

Stevens,  J.P.,  1996.  Applied  Multivariate  Statistics  for  the  Social  Sciences.  Routledge, 
New  York. 

Tabachnick,  B.G.,  Fidell,  L.S.,  1996.  Using  Multivariate  Statistics.  Harper-Collins,  New 
York,  NY. 

Thompson,  R.C.,  Hilton,  T.F.,  Witt,  L.A.,  1998.  Where  the  safety  rubber  meets  the 
shop  floor:  a  confirmatory  model  of  management  influence  on  workplace 
safety.  Journal  of  Safety  Research  29  (1),  15-24. 


138 


P.  O’Connor  et  al./Safety  Science  49  (201 1 )  128-138 


Wiegmann,  D.A.,  Zhang,  H.,  von  Thaden,  T.L.,  Sharma,  G.,  Gibbons,  A.M.,  2004.  Safety 
culture:  an  integrative  review.  The  International  Journal  of  Aviation  Psychology 
14,  117-134. 

Zohar,  D.,  1980.  Safety  climate  in  industrial  organizations:  theoretical  and  applied 
implications.  Journal  of  Applied  Psychology  65,  96-102. 


Zohar,  D.,  2000.  A  group-level  model  of  safety  climate:  testing  the  effect  of  group 
climate  on  micro-accidents  in  manufacturing  jobs.  Journal  of  Applied 
Psychology  85  (4),  487-596. 


